DOCUMENT RESUME 



ED 077 201 



EM Oil 085 



AOlHOB 
TITLE 

INSTITOTION 

SPONS AGEIICy 
PUB DATE 
NOTE 



Fletcher, J. . D. ; Jamison, D. T. 
Computer-Assisted Instruction and Equality in 
Educational Achievement. 

Stanford Univ., Calif. Inst, for Mathematical Studies 
in Social Science. 

National Science Foundation* Washington, D.C. 
Feb 73 

22p.; Paper presented at the Annual Meeting of the 
American Educational Research Association (Mew 
Orleans, Louisiana, February 25-March 1, 1973) 

MF-J0.65 BC-$3.29 

Compensatory Education; ^Computer Assisted 
Instruction; *Egual Education; ^Mathematical Models; 
^Program Effectiveness 

ABSTRACT 

Several different mathematical methods for 
dprtimization of ih^tiniictioh ax# pr^seht^d and cdngpared. A nay in 
^iifi: one of these mstlx>ds inight be j^pjplied to the measurement and 
avoidance of inequality in educational bpportiniity sund performance is 
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iiisti^ction might provide a particularly appropriate frame within 
which these methods might be employed. (KB) 



EDBS PRICE 
DESCRIPTORS 



U.S. DEPARTMENT Oh HEALTH. 
EOUCATiON * WELFARE 
' OFFICE OF EOUCATION 
THIS DOCUMENT HAS BEEN REPRO- 
OUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORiG- 
INATING IT POINTS OF VIEW OR OPIN. 
IONS STATED DO NOT NECESSARILY 
REPRESENT OFFIQAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



CX)MPUTER-ASSIS*ED INSTRUCTION AND EQUALITY 

IN EDUCATIONAL ACIilSVEMEWT''" ' ^ 

J. D. Fletcher and D. T. Jarnisor 

Stanford University 
Stanford, California 9^^305 



SCOPE OF INTEREST NOTICE 
The ERIC Faotity hasMsigrMd 
this document for processing 



In our judgement, this document 
isaiso of interest to the clearing- 
houses noted to the right. indeic> 
ing should reflect their spectai 
pomts of view. 



6 



This paper extends ideas presented earlier by Jamison, Fletcher, Suppes, 
and Atkinson {1973), and applies them more explicitly to the optiirazat^cn of 
instruction and concopiitantly to the evaluation of educational ir.puts. T*he 
version of the paper presented today is preliminary in that xhe applicc^xions 
of inequality aversion outlined will be extended and explicitly fozTiiailzea 
in a version we expect to submit for publication early this summer. It 
will become apparent that our ccxnments are equally applicable to the optimi- 
zation of computer-assisted instruction (CAI), to curriculum evaluation, and 
to the evaluation of educational inputs; the emphasis in this version is on 
CAI. 

There is a current view that what goes on in schools i;as little effect 
on the achievement of students. This view received considerable support from 
the Coleman Report (Coleman, Campbell, Hobson, McPartland, Mood, Weinfeld, 
& fork, 1966) and from Jensen (1969). Coleman concluded that factors within 
the schools seem to effect achievement much less than do factors outside 
the schools: these somewhat disheartening conclusions have been subject to 
rigorous debate since their initial publication, and Jamison, Suppes, and 
Wells (1973) provide a review of the relevant literature. 

Our CAE WO]*, however, has led us to more optimistic conclusions con- 
cerning the potential capability of the schools to affect scholastic 
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perfozroance. We have fotind strong and consistent achievement gains by students 
when they are given CAE over a reasonable fraction of a school year. As Bowles 
and Levin (1968) pointed out: "The findings of the Report are particularly 



and canpositions of resources devoted to schooling because the range of vari- 
ation in most school inputs in this sample is much more limited than the range 
of policy measures currently under discussion." Many evaluations of CAE" provide 
detailed infoimat:..on about the output effects of a much broader variety of 
school inputs than the Coleman Report considered. 

CAE can be used or abused. Used properly, it is an extremely effective 
pedagogical tool and presents a serious possibility for the improvement of 
education. A review of successful CAE projects is not within the scope of 
this paper. Vinsonhaler and Bass (1972) and Jamison,- Suppes, and Wells (19^2) 
present useful reviews of CAE evaluation literature, and we suspect there are 
other good reviews either available or in preparation. 

In addition to the evaluation of CAE, the effort to optimize CAE as an 
educational input seems to be increasingly prominent. We should note that the 
teims 'maximization* and 'optimization* are not synonymous. Optimization, - 
at least as we use it, refers to the simultaneous maximization of marginal 
utilities iinder constraints that may be intei^iependent and/or in conflict. 
Recent work reported by Atkinson and PaxOson (1972), Chant and Atkinson (1973), 
and Laubsch (1970) indicate an increasing interest in the optimization of 
instruction. 



requires that the problem be stated in a fom amenable to decision-theoretic 



inappropriate for assessing the like;iy effects of radical changes in the level 



As Atkinson 




'2) points out, the derivation of an optimal strategy 



analysis. Four elements are required prior to the derivation of an optimal 
instructional strategy: 

1. A model of the learning process. 

2. Specification of admissible instructional actions. 
3* Specification of instructional objectives. 

h. A measurement scale that peimits costs to be assigned to each of 

the instructional actions and payoffs to the achievement of instruc- 
tional objectives. 
In this paper, ve assume th^t adequate models of the learning process 
required by element 1 exist. This assumption is not as cavalier as it may 
seem. Already, Lorton (1973) has applied incremental and all-or-none models 

m 

to CAE iu spelling, and Laubsch (1970) has applied the random-trial increments 
model to CAI for foreign language vocabulary. 

We assume that element 2 exists as a repertoire of educational inputs. 
This element is critical in -deteimining the effecti\'eness of a decision-theoiy 
analysis; vaiying the set of actions from which the decision-maker is free to 
choose changes the decision problem, even though the other elements remain . 
the same. 

We also assume element 3 exists. It is important to distinguish betweeh 
element 3 and the "second half of element k. Element 3 merely provides that 
the set of educational outcomes under consideration can be explicated and 
listed. The second half of element k provides a weighting function that can 
be applied to element 3 J it insures that the relative importance of the 
educational outputs in element 3 can be specified as a ratio scale. 



We refer the interes^:ed- reader to Levin (IS^O, 1S73) for sane important 
work emphasizing the first half of element k which may be described as alio- 
cative efficiency. Our emphasis is on one aspect of the second half of element 
k, explicating the equality of desired educational outcomes. 

Having reduced the problem of optimal decision making in educational policy 
to (perhaps) manageable proportions, we will discuss equality of educational 
outcome in general terms and show how it can be applied to evaluation and 
optimization of instruction.^ 

Equality 

Our remarks draw illiastrative data -from two CAE programs: an initial 
reading program for grades K-3 described by Atkinson and Fletcher (1972), and 
an elementary school arithmetic program described hy Suppes and Momingstar 
(1969)» Evidence that these programs have a positive effect on educational 
outcomes is presented by Fletcher and Atkinson (1972) for the reading program 
and by Suppes and Momingstar for the arithmetic program. 

Gini coefficients . We first use a traditional measure of inequality, 
the Gini coefficient, to examine inequality in achievement gains. Consider 
a group of students who have taken an achievement test; each student will 
have achieved some score on the test, and there will be a total scor^ obtained 
by summing all the individual scores. We can then ask what fraction of the 
total score was obtained iiy the 10 percent of students doing most poorly on 
the test, what fraction was obtained by the 20 percent of students doing 
most poorly, etc. For that matter, we can plot fraction of total score 
earned by the bottom x percent of students as a function of x. 



These concepts may be expressed more; fomally in the notc^'ion of Lovine 
and Singer (1970) as follows. Let N(u) be the achievement-score density 
function. Then N(u)du represents the number of individuals scoring between 
u and u + du. The total number of students, N, and their average scoie. A, 
are given by: 



_0D 



N = J N(u)du, and 
0 

CO 

A = ~ / uN(u)du . 



The fraction of students scoring a or less is given by 

f(^) = i / N(u)du , 
and the fraction of the total score obtained by students scoring a or less is 



J 



a 

uN(u)du 
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We can, then, plot g(a) as a function of f(a) for all a with respect to 
a particular educational outcome. If there is perfectly equal distribution 
of achievement, the resulting curve, called a Lorenz curve in econometric 
literature, is a k^" line. The more the obtained Lorenz curve differs from 
a 1*5' line— the more it 'sags'—the more unequal is thv3 distribution of 
achievement. Illustrative LorenOurves are plotted in Figure 1. 



The Gini coefficient is an aggregate nieasur^ of inequality that is defined 
as the ratio of the area between g(a) and the line to the ax^a between the 
45' line and the abscissa. If the GinL coefficient is zero the distribution 
of achievement is completely unifom; the larger the Gini coefficient, the 
more unequal the distribution. 

We used Gini coefficients to access the extent to which the fading and 
arithmetic CAI programs were inequality reducing. Table 1 displays Gini coef- 
ficients for CAT and control groups for the three reading posttests used by 
Fletcher and Atkinson. The subjects in this study were kk matched pairs of 
nrst grade students. The three posttests were the Stanfoz^ Achievement Test 
(SAT), the Califoniia Cooperative Priiaaxy Reading Test (cOOP), and an instru- 
ment (DF) designed by the project to test the precise objectives of the CAI 
reading curriculum. The CAT and control gxxmps are compa^^ble because they 
v^re carefully matched 1^ pretest achievement prior to the CAI treatment. 

Table 2 displays Gini coefficients for six grades of about 100 students 
each in Mississippi. For Table 2, we computea Gini coefficients for the 
distribution Of achievement in the CAI and contxx^l gxx^ups before and after 
the arithmetic CAI was used. For each group at each grade level we present 
Gini coefficients for the pretest, for the posttest, and for the difference 
between the two. This infomation is given for both the C^ group and the 
control group, m the final column of Table 2 the difference between columns 
3 and 6 is shown; if this difference is positive it indicates that there was 
a greater reduction in inequality in the CAI group .than in the control group. 
, Presumably, statistical statements could be made about the distribution 
Of Gini coefficients sn6/or their differences, but we want to limit our dis- 
cussion Of them. Gini coefficients are fairly well established as i»easures 



Table 1 

Coefficients for Reading Achievement Posttests^ 





CAI 


Control 


SAT 






COOP 


.183 


.266 


DP 


.068 


.152 



Control-CAI 
.01+0 
.083 
.084 



SSt^^t^!"^?^ snatching of CAI and control gwups by 
shovnf^'"'' ^^"i coefficie^tTfi"^ 



Table 2 

Gini Coefficients for Control Groups and Experimental 
Groups Given Arithmetic CAI 







CAI 




Control 








PRE 


POST 


PRE- 

POST 


PRE 


PO^T 


PRE- 
POST 


VPre-Post) 
/Control \ 
^Pre-Post/ 


Grade 1* 


.057 


.067 


-.010 


.037 


.062 


-.025 


.015 


2 


,06h 


.039 


.025 


.055 


.050 


.005 


.020 


3 


,016 


.032 


-.016 


.035 


.038 


-.003 


-.013 


k 


.080 


.053 


.027 


.08i* 


.065. 


.019 


.008 


5 


.095 


.070 * 


.025 


.078 


.079 


-.001 


.026 


6 


.068 


.077 


-.009 


.078 


.084 


-.006 


-.003 



0 

Gini coefficients are cocq?uted from Stanford Achievement Test, 
Computation subscale, grade placements « 
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of inequality, t(ut as Anthony Atkinson (I97O) haa pointed cut, they have a 
nuiaber of shortccnings , nost notable of vhich is that they are not puit-ly 
eaoiiical measures but contain an ',;nderlying ^/alue oudgment concerning vh&t 
constitutes inequality. Further, Xewbeiy (ISr^o) demonstrated that it is 
impossible to explicate this value judgment by means of any additive utility 
function. Therefore, we turn to two value explicit jaeasures of inequality. 

Value Explicit Measures of Inequality 

Use of the value explicit measures of Gini coefficients implies that 
achievement test scores should be measured on a ratio scale (i.e., the achieve- 
ment measure must be unique up to multiplication by a positive constant). If, 
for example, achievement measures were oniy unique up to a positive linear 
transfomation, the Gini coefficient could be made arbitrarily small by adding 
an arbitrarily laige amount to each individual's achievement test score. Our 
assumption that achievement is measured on a ratio scale is quite strong; on 
the other hand, a ratio scale is essentially implicit in the assumption that 
one test score is better than another if and only if the number of problems 
correct on the one test is greater than the number correct on the other. 

We take Anthony Atkinson's suggestion, and consider the measure W to be 
the overall utilily of an educational treatment. Ve tefine W in terms of a 
distribution of achievement scores, N(u), as 

W = jT U(u) N(u)du , 

where V is the naxiaum posttreatment measure attainable and U(u) is increasing 



and concave. U(u) is, m effect, a vcighting rar.ction that uofir.c;; t.ie opti.T,aX 
distribution of pOGtt2\3atr:ent achievement. The extra require.v.er4t of concavity 
on U(u) ii^plies that the optinal distribution of posztreatr.cnt acniever-ent is 
inequality averting. More precisely, there is a level of achievement, u^, 
that is lo',ter than the average level of acM.eve:r.ent in the population under 
consideration such that if evezj^one in the population had exactly post- 
treatment achievenient the overall utility accruing froa the educational 
treataent would remain constant at W. Further, if u is the average level of 
posttreatment achievement, a reliable ceasure of inequality, 1, is given by 

u 

u 

The lover I is, the more equal is the. distribution of achievement. The measure 
I ranges betyeea 0 for cocrplete eq\iaiity and 1 for complete inequality and 
indicates, in effect, by what percentage total achievement could be reduced 
to obtain the same level of W if the achievement level vere equally distributed* 

In order to a^ply the measure I ve consider two classes of functions of 
U. The first of these was suggested by Atkinson and has the property of 
"constant relative inequality aversion" ^ch simply means that multiplying 
all achievement levels in the distributions by a positive constant does not 
alter the measure I of inequali^. If there is constant relative inequality 
aversion it is known from the theory of risk aversion that U(u) must have the 
following form: 

U(u) » a + b -—^ if € / 1, and 



U(u) s in(u) if € = 1 



Another possibility that Atki/ sc. 'considers is thac of constant absolute in- 
equality aversion, vhich means thtt adding a constant to each achieveir.ent level 
in the distribution does not alter the measure of inequality. A theoren of 
Pfanzagl (1959) can be used to show that if there is constant absolute in- 
equality aversion, then U(u) must have one of the following two foims: 

U(u) = au + b , or 

U(u) = aX^ + b . 

% 

Strict concavity implies the latter of these two and that 0 < X < 1. 

We have then two families of utility functions, one indexed by e and the 
other by X. These families include a large number of qualitatively important 
alternatives for U. In Figure 2 U(u) is shown for several values of e, and 
in Figure 3 U(u) is shown for several- valxies of X. Since transforming the 
functions depicted in Figures 2 and 3 by a positive linear trans format ion ''does 
not affect the measure I> the height and location of the functions in those 
two figures is arbitrary. 

It is clear that the measvre I will vaiy with € or X for any fixed dis- 
tribution of achievement. In Figure 3 we have constrained U(u) -to pass through 
0 and 1 for all values of X implying that U(u) = (l-X^)/(l-X) . For X very 
close to 1 inequality is close to C; as X gets smaller and smaller, then 
ineqixality will get larger for any fixed distribution. The way in which I 
varieb with e is just the opposite; low values of € give a low measure of in- 
equality whereas large values of € give large values for I. 

One value of indexing a measure cf ineqxxality by some parameter (such 
as € or X) that describes the degree of inequality aversion is that achievement 



12 



in some groups may be Judged to be more equal for ccrv.e values of the para-meter 
than for others • Table 3 includes reversals as a function of g under the as- 
sumption of constant relative inequality aversion, and Table k includes some 
reversals as a function of X. From Tables 3 k it can be seen that the. 
parameters (e and X) explicate value judgments for any pQsttreatment distri- 
bution of achievement. 

Applications 

'"^ Optimization . A very natural application of these measures of inequality 
is in the optimization of instruction. Procedures that are indicated by such 
an application are not limited to CAT, but CAT appears to be the most facile 
medium for them. In any case, a reasonable next step is to design patterns 
of CAI presentation that are optimal for some utility function U maximized 
subject to such constraints as the distribution of prior achievement in the 
student population, the total number of terminal hours available, and/or a 
production function that relates CAI time or number of CAI sessions to gains 
in measured achievement. 

Elaborate and complex mathematical models are not needed for these appli- 
cations. Suppes, Fletcher, and Zanotti (1S73) applied a simple linear model 
in setting grade placement goals in CAI. This model was of the form 



where GGP^. was the goal grade placement for student i, was the number of 
CAI sessions for student i, and a^ and a^ were parameters of the model. The 
range in standard error for this model over the population of students con- 
sidered was about .02^. Ok years in grade placement; despite its simplicity 
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Table 3 

CAI Inequali-cy Reduction: Constant Relative Inequality 
Under Arithmetic CAI^ 



e 



student Group 


.20 


.60 


1.0 


l.k 


1.8 


2.2 


2.6 


3.0 


Grade 1 


.001 


.002 


.001; 


.005 


.006 


.007 


.00? 


.00? 


2 


.00k 


.012 


.020 


.030 


.Okl 


.05^^ 


'.068 


.081^ 


3 


-.002 


-.005 


-.008 


-.012 


-.015 


-.019 


-.021^ 


-.029 


k 


.002 


.005 


.009 


.01k 


.020 


.028 


.038 


.050 


5 


.005 


.012 


.019 


.023 


.026 


.027 


.025 


.022 


6 


.000 


-..002 


-.003 


-.00k 


-.006 


-.007 


-.009 


-.010 



The numbers shown in the table are I. - I as a function of €• I. is 

the difference in inequality between CAI and control after treatment 
(i.e., on the posttest) and I is the difference before treatment. If 
the difference is greater after treatment than before, CAI is inequality- 
reducing. 



Table h 

CAE Inequality Reduction: Constant Absolute Inequality 
Aversion Under Ari time tic CAI 



X 



Student Group 


.90 


.80 


.70 


.60 


.50 


.1+0 


.30 


.20 


Grade 1 


-.001 


-.005 


-.009 


-.011 


-.013 


-.005 


.011 


.030 


2 


.010 


.Olvl 


.090 


.127 


.11*6 


.li+8 


.139 


.120 


3 


-.131 


-.180 


-.237 


-.297 


-.331 


-.331 


-.300 


-.21+6 


k 


-.013 


.016 


.050 


.05^* 


.Ohk 


.033 


.021+ 


.017 


5 


.01^8 


.006 


-.010 


-.007 


.000 


,00k 


.009 


.016 


6 


-.083 


-.108 


-.098 


-.078 


-.060 


-.dkS 


-.037 


-.030 


^The numbers 


shown in the table are 




as a function 


of X. 


^a" 



the difference in inequality between CAI and control after treatment 
(i*e*, on the posttest) and I., is the difference before treatment. If 
the difference is greater after treatment than* before, CAI is inequality- 
reducing. 
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the raodel was quite precise. This .model could be eu^lly used tc rriaxir.rlze U 
subjecu to constraints on the number of C.AI sesGions zhat could be assigned 
vithin a student popxilation. Such an application v;ould represe.it a significant 
improvement over previous work in that the value judgments underlying the 
notion of optimization would be explicit in the parameters of the utility 
function. 

Evaluation of educational inputs . We believe that a more iiraortant appli- 
cation of these explications of utility is to the evaluation of educational 
inputs in general. There is currently some discussion of a 'meritocracy'^ 
preserved by inequality in educational inputs (Stein, I97I). ^jr forcing an 
explication of the inequality averting properties of these inputs in terns of 
their probable outcomes, the achievement of equality in educational opportunity 
can be made far more probable. In any case, we would be disappointed to see 
indiscriminent application of educational Inputs without an effort to expli- 
cate the value judgments that underlie their allocation. 
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^e have a deadline of 1 July I973, 

Originally, we planned to discuss equality cf outcome in ccnpensatoiy 
education. The restriction of our remarks to coapensatoiy education now 
appears unnecessaiy. 
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